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STRUCTURAL SYMMETRY IN EVOLUTIONARY GAMES 


ALEX MCAVOY AND CHRISTOPH HAUERT 


Abstract. In evolutionary game theory, an important measure of a mutant trait (strategy) is its ability 
to invade and take over an otherwise-monomorphic population. Typically, one quantifies the success of a 
mutant strategy via the probability that a randomly occurring mutant will fixate in the population. However, 
in a structured population, this fixation probability may depend on where the mutant arises. Moreover, the 
fixation probability is just one quantity by which one can measure the success of a mutant; fixation time, 
for instance, is another. We define a notion of homogeneity for evolutionary games that captures what it 
means for two single-mutant states, i.e. two configurations of a single mutant in an otherwise-monomorphic 
population, to be “evolutionarily equivalent” in the sense that all measures of evolutionary success are the 
same for both configurations. Using asymmetric games, we argue that the term “homogeneous” should 
apply to the evolutionary process as a whole rather than to just the population structure. For evolutionary 
matrix games in graph-structured populations, we give precise conditions under which the resulting process 
is homogeneous. Finally, we show that asymmetric matrix games can be reduced to symmetric games if the 
population structure possesses a sufficient degree of symmetry. 


1. Introduction 


One of the most basic models of evolution in finite populations is the Moran process (Moran 19581. In 
the Moran process, a population consisting of two types, a mutant type and a wild type, is continually 
updated via a birth-death process until only one type remains. The mutant and wild types are distinguished 
by only their reproductive fitness, which is assumed to be an intrinsic property of a player. A mutant type 
has fitness r > 0 relative to the wild type (whose fitness relative to itself is 1), and in each step of the process 
an individual is selected for reproduction with probability proportional to fitness. Reproduction is clonal, 
and the offspring of a reproducing individual replaces another member of the population who is chosen for 
death uniformly at random. Eventually, this population will end up in one of the monomorphic absorbing 
states: all mutant type or all wild type. In this context, a fundamental metric of the success of the mutant 


type is its ability to invade and replace a population of wild-type individuals (Nowak, 20061. 


In a population of size N, the probability that a single mutant in a wild-type population will hxate in the 
Moran process is 

1 — r~^ 

In this version of a birth-death process, the members of the population are distinguished by only their types; 
in particular, there is no notion of spatial arrangement, i.e. the population is well-mixed. [Lieberman et ah] 
(20051 extend the classical Moran process to graph-structured populations, which are populations with links 
between the players that indicate who is a neighbor of whom. In this structured version of the Moran 
process, reproduction happens with probability proportional to fitness, but the offspring of a reproducing 
individual can replace only a neighbor of the parent. Since individuals are now distinguished by both their 
types (mutant or wild) and locations within the population, a natural question is whether or not the fixation 
probability of a single mutant type depends on where this mutant appears in the population. |Lieberman| 
et al. (2005) show that this fixation probability is independent of the location of the mutant if everyone has 


the same number of neighbors, i.e. the graph is regular (Bollobas, 2001). In fact, remarkably, the fixation 
probability of a single mutant on a regular graph is the same as that of Eq. ([^-an observation first made 


in a special case by Maruyama (1974). This result, known as the Isothermal Theorem, is independent of the 


number of neighbors the players have (i.e. the degree of the graph). 

The Moran process is frequency-independent in the sense that the htness of an individual is determined by 
type and is not influenced by the rest of the population. However, the Moran model can be easily extended 
to account for frequency-dependent fitness. A standard way in which to model frequency-dependence is 
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through evolutionary games (Taylor and Jonker 1978 Hofbauer and Sigmund 1998 Nowak et al. 20041. 


In the classical setup, each player in the population has one of two strategies, A and B, and receives an 
aggregate payoff from interacting with the rest of the population. This aggregate payoff is usually calculated 
from a sequence of pairwise interactions whose payoffs are described by a payoff matrix of the form 


( 2 ) 


Each player’s aggregate payoff is then translated into fitness and the strategies in the population are updated 
based on these fitness values. Since a player’s payoff depends on the strategies of the other players in the 
population, so does that player’s fitness. Traditionally, this population is assumed to be infinite, in which case 



the dynamics of the evolutionary game are governed deterministically by the replicator equation of Taylor 


and Jonker 


et al. 2004 


(19781. More recently, evolutionary games have been considered in finite populations (Nowak 


Taylor et al., 2004), where the dynamics are no longer deterministic but rather stochastic. In 


order to restrict who interacts with whom in the population, these populations can also be given structure. 


Popular types of structured populations are graphs (Lieberman et al. 2005 Ohtsuki et al. 


Fath, 2007), sets (Tarnita et al. 2009), and demes (Taylor et al. 2001 Hauert and Imhof 


2006 


2012 ). 


Szabo and 


We focus here on evolutionary games in graph-structured populations that proceed in discrete time steps. 
Such processes define discrete-time Markov chains, either with or without absorbing states (depending on mu¬ 
tation rates). Typically, in evolutionary game theory, one starts with a population of players and repeatedly 


updates the population based on some update rule such as birth-death (Nowak et al.l 2004), death-birth 


These update rules can be split into two classes: cultural and genetic (see McAvoy and Hauert 


(Ohtsuki et al. 2006 Zukewich et al. 2013), imitation (Ohtsuki and Nowak, 2006), pairwise comparison 
(Szabo and Toke, 1998 Traulsen et al. 2007), or Wright-Fisher ( Ewens[ 2004 Imhof and Nowak 


2006). 


2015b I. 


Cultural update rules involve strategy imitation while genetic update rules involve reproduction and inher¬ 
itance. Without mutations, an update rule may be seen as giving a probability distribution over a number 
of strategy-acquisition scenarios: a player inherits a new strategy through imitation (cultural rules) or is 
born with a strategy determined by the parent(s) (genetic rules). Mutation rates disrupt these scenarios by 
placing a small probability of a player taking on a novel strategy. The way in which strategy mutation rates 
are incorporated into an evolutionary process depends on both the class of the update rule and the specifics 
of the update rule itself. In a general sense, we say that strategy mutations are homogeneous if they depend 
on neither the players themselves nor the locations of the players. This notion of homogeneous strategy 
mutations is analogous to that of a symmetric game, which is a game for which the payoffs depend on the 
strategies played but are independent of the identities and locations of the players. 

The Isothermal Theorem seems to indicate that populations structured by regular graphs possess a signif¬ 
icant degree of homogeneity, meaning that different locations within the population appear to be equivalent 
for the purposes of evolutionary dynamics. However, it is important to note that (i) fixation probability is 
just one metric of evolutionary success and (ii) the Moran process is only one example of an evolutionary 
process. For example, in addition to the probability of fixation, one could look at the absorption time, which 
is the average number of steps until one of the monomorphic absorbing states is reached. Moreover, one 
could consider frequency-dependent processes, possibly with different update rules, in which fitness is no 
longer an intrinsic property of an individual but is also influenced by the other members of the population. 
We show that the Isothermal Theorem does not extend to arbitrary frequency-dependent processes such as 
evolutionary games. Furthermore, we show that this theorem does not apply to fixation times; that is, even 
for the Moran process on a regular graph, the average number of updates until a monomorphic absorbing 
state is reached can depend on the initial placement of the mutant. 

Given that the Isothermal Theorem does not extend to other processes defined on regular graphs, the 
next natural question is the following: what is the meaning of a spatially-homogeneous population in evo¬ 


lutionary game theory? In fact, we argue using asymmetric games (McAvoy and Hauert 2015b) that the 


term “homogeneous” should apply to an evolutionary process as a whole rather than to just the population 
structure. Even for populations that appear to be spatially homogeneous, such as populations on complete 
graphs, non-uniform distribution of resources within the population can result in heterogeneity of the overall 
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process. Similarly, for symmetric games, heterogeneity can be introduced into the dynamics of an evolution¬ 
ary process through strategy mutations. Therefore, a notion of homogeneity of an evolutionary game should 
take into account at least (i) population structure, (ii) payoffs, and (iii) strategy mutations. 

If the strategy-mutation rates are miniscule, then the population spends most of its time in monomorphic 
states. With small mutation rates, one can define an embedded Markov chain on the monomorphic states 
and use this chain to study the success of each strategy (Fudenberg and Imhof 2006 Wu et al. 20111. That 
is, when a mutation occurs, the population is assumed to return to a monomorphic state before another 
mutant arises. Thus, the states of interest are the monomorphic states and the states consisting of a single 
mutant in an otherwise-monomorphic population. We say that an evolutionary game is homogeneous if any 
two states consisting of a single mutant (A-player) in wild-type population (i3-players) are mathematically 
equivalent. We make precise what we mean by “mathematically equivalent” in but, informally, this 
equivalence means that any two such states are the same up to relabeling. In particular, all metrics such as 
fixation probability, absorption time, etc. are the same for any two states consisting of a single A-mutant in 
a i?-population. We show that an evolutionary game in a graph-structured population is homogeneous if the 
graph is vertex-transitive (“looks the same” from each vertex), the payoffs are symmetric, and the strategy 
mutations are homogeneous. This result holds for any update rule and selection intensity. 

Finally, we explore the effects of population structure on asymmetric evolutionary games. In the weak 
selection limit, we show that asymmetric matrix games with homogeneous strategy mutations can be reduced 
to symmetric games if the population structure is arc-transitive (“looks the same” from each edge in the 
graph). This result is a finite-population analogue of the main result of McAvoy and Hauert (2015b|, which 
states that a similar reduction to symmetric games is possible in sufficiently large populations. Thus, we 
establish that this reduction applies to any population size if the graph possesses a sufficiently high degree 
of symmetry. Our explorations, both for symmetric and asymmetric games, clearly demonstrate the effects 
of population structure, payoffs, and strategy mutations on symmetries in evolutionary games. 


2. Markov chains and evolutionary equivalence 

2.1. General Markov chains. The evolutionary processes we consider here define discrete-time Markov 
chains on finite state spaces. The notions of symmetry and evolutionary equivalence that we aim to introduce 
for evolutionary processes can actually be stated quite succinctly at the level of the Markov chain. We first 
work with general Markov chains, and later we apply these ideas to evolutionary games. 

Definition 1 (Symmetry of states). Suppose that X = {Xn}^^^ is a Markov chain on a (finite) state space, 
§, with transition matrix T. An automorphism of A is a bijection § such that for 

each 5, s' G S. Two states s,s' G § are said to be symmetric if there exists (p G Aut (X) such that (p (s) = s'. 

Definition[T]says that the states of the chain can be relabeled in such a way that the transition probabilities 
are preserved. This relabeling may affect the long-run distribution of the chain since it need not fix absorbing 
states, so we make one further refinement in order to ensure that if two states are symmetric, then they 
behave in the same way: 

Definition 2 (Evolutionary equivalence). States s and s' are evolutionarily equivalent if there exists an 
automorphism of the Markov chain, (p G Aut (A), such that 

(i) p (s) = s'; 

(ii) if /X is a stationary distribution of A, then p (fj.) = 

For a Markov chain with absorbing states, the notions of symmetry and evolutionary equivalence of states 
need not coincide (see Example]^ of Appendix B). However, if the Markov chain has a unique stationary 
distribution (as would be the case if it were irreducible), then symmetry implies evolutionary equivalence: 

Proposition 1. If A has a unique stationary distribution, then two states are symmetric if and only if they 
are evolutionarily equivalent. 

We show in Appendix B that a Markov chain symmetry preserves the set of stationary distributions 
(Lemma [^, so if there is a unique stationary distribution, then condition (ii) of Definition is satisfied 
automatically by any symmetry. Proposition [l] is then an immediate consequence of this result. 
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If s and s' are evolutionarily equivalent, then it is clear for absorbing processes that the probability that s 
fixates in absorbing state s is the same as the probability that s' fixates in state s (and similarly for fixation 
times). If the process has a unique stationary distribution, then the symmetry of s and s' implies that this 
distribution puts the same mass on s and s'. These properties follow at once from the fact that the states s 
and s' are equivalent up to relabeling. 

2.2. Markov chains defined by evolutionary games. Our focus is on evolutionary games on fixed 
population structures. If S' is a finite set of strategies (or “actions”) available to each player, and if the 
population size is iV, then the state space of the Markov chain defined by an evolutionary game in such a 
population is § = . For evolutionary games without random strategy mutations, the absorbing states of 

the chain are the monomorphic states, i.e. the strategy profiles consisting of just a single unique strategy. 
Thus, states s and s' are evolutionarily equivalent if they are symmetric relative to the monomorphic states. 
On the other hand, evolutionary processes with strategy mutations are typically irreducible (and have unique 
stationary distributions); in these processes, the notions of symmetry and evolutionary equivalence coincide 
by Proposition [2 

In order to state the definition of a homogeneous evolutionary process, we first need some notation. For 
s, s' S S, denote by 5(^s',i),s the state in whose zth coordinate is s' and whose jth coordinate for j i is 
s; that is, all players are using strategy s except for player i, who is using s'. 

Definition 3 (Homogeneous evolutionary process). An evolutionary process on is homogeneous if for 
each s,s' G 5, the states S(s',i),s and S(s/are evolutionarily equivalent for each i,j = An 

evolutionary process is heterogeneous if it is not homogeneous. 

In other words, an evolutionary process is homogeneous if, at the level of the Markov chain it defines, any 
two states consisting of a single mutant in an otherwise-monomorphic population appear to be relabelings 
of one another. As noted in 0 all quantities with which one could measure evolutionary success are the 
same for these single-mutant states if the process is homogeneous. 

3. Evolutionary games on graphs 

We consider evolutionary games in graph-structured populations. Unless indicated otherwise, a “graph” 
means a directed, weighted graph on N vertices. A directed graph is one in which the edges have orientations, 
meaning there may be an edge from i to j but not from j to i. Moreover, the edges carry weights, which 
we assume are nonnegative real numbers. A directed, weighted graph is equivalent to a nonnegative N x N 
matrix, where there is an edge from i to j if and only if ^ij ^ 0. If there is such an edge, then the weight 
of this edge is simply Since there is a one-to-one correspondence between directed, weighted graphs on 
N vertices and N x N real matrices, we refer to graphs and matrices using the same notation, describing ^ 
as a graph but using the matrix notation to indicate the weight of the edge from vertex i to vertex j. 

Every graph considered here is assumed to be connected (strongly), which means that for any two vertices, 
i and j, there is a (directed) path from i to j. This assumption is not that restrictive in evolutionary game 
theory since one can always partition a graph into its strongly-connected components and study the behavior 
of an evolutionary process on each of these components. Moreover, for evolutionary processes on graphs that 
are not strongly connected, it is possible to have both (i) recurrent non-monomorphic states in processes 
without mutations and (ii) multiple stationary distributions in processes with mutations. Some processes 
(such as the death-birth process) may not even be defined on graphs that are not strongly connected. 
Therefore, we focus on strongly-connected graphs and make no further mention of the term “connected.” 

Since our goal is to discuss symmetry in the context of evolutionary processes, we first describe several 
notions of symmetry for graphs. The three types of graphs we treat here are regular, vertex-transitive, 
and symmetric. Informally speaking, a regular graph is one in which each vertex has the same number of 
neighboring vertices (and this number is known as the degree of the graph). A vertex-transitive graph is one 
that looks the same from any two vertices; based on the graph structure alone, a player cannot tell if he or 
she has been moved from one location to another. A symmetric (or arc-transitive) graph is one that looks 
the same from any two edges. That is, if two players are neighbors and are both moved to another pair of 
neighboring vertices, then they cannot tell that they have been moved based on the structure of the graph 
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regular graphs 



Figure 1. Three different levels of symmetry for connected graphs. Regular graphs have 
the property that the degrees of the vertices are all the same. Vertex-transitive graphs look 
the same from each vertex and are necessarily regular. Symmetric (arc-transitive) graphs 
look the same from any two (directed) edges. Each of these containments is strict; there 
exist graphs that are regular but not vertex-transitive (Fig. and vertex-transitive but not 
symmetric (Fig. j^A)). 


alone. We recall in detail the formal definitions of these terms in Appendix B. The relationships between 
these three notions of symmetry, as well as some examples, are illustrated in Fig. 

We turn now to evolutionary processes in graph-structured populations: 


3.1. The Moran process. Consider the Moran process on a graph, Lieberman et al. (2005) show that 
if @ is regular, then the fixation probability of a randomly placed mutant is given by Eq. ([^, the fixation 
probability of a single mutant in the classical Moran process. This result (known as the Isothermal Theorem) 
proves that, in particular, this fixation probability does not depend on the initial location of the mutant. 
(We refer to this latter statement as the “weak” version of the Isothermal Theorem.) Our definition of 
homogeneity in the context of evolutionary processes (Definition is related to this independence of initial 
location and has nothing to do with fixation probabilities in the classical Moran process. Naturally, the 
Isothermal Theorem raises the question of whether or not this location independence extends to absorption 
times (average number of steps until an absorbing state is reached) when 2) is regular. 

Suppose that 2 is the Frucht graph of Fig. The Frucht graph is an undirected, unweighted, regular (but 
not vertex-transitive) graph of size 12 and degree 3 (Frucht 1939). The fixation probabilities and absorption 


times of a single mutant in a wild-type population are given in Fig. as a function of the initial location 
of the mutant. The fixation probabilities do not depend on the initial location of the mutant, as predicted 
by the Isothermal Theorem, but the absorption times do depend on where the mutant arises. In fact, the 
absorption time is distinct for each different initial location of the mutant. The details of these calculations 
are in Appendix C. Therefore, even the weak form of the Isothermal Theorem fails to hold for absorption 
times. In particular, the Moran process on a regular graph need not define a homogeneous evolutionary 
process. 

This setup involving two types of players, frequency-independent interactions, and a population structure 
defined by a single graph, can be generalized considerably: 

3.2. Symmetric games. A powerful version of evolutionary graph theory uses two graphs to define re¬ 


lationships between the players: an interaction graph, S, and a dispersal graph, 2 (Ohtsuki et al. 2007a 


Taylor et al. 

o 

o 

Ohtsuki et al. 2007b 

Pacheco et al. 

2009 

Debarre et al. 2014 


nonnegative weights. As an example of how these two graphs are used to define an evolutionary process, we 
consider a birth-death process based on two-player, symmetric interactions: 
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fixation probability 


Figure 2. A single mutant (cooperator) at vertex 11 of the Frucht graph. In the Snowdrift 
Game, the probability that cooperators fixate depends on the initial location of this mutant 
on the Frucht graph (even if the intensity of selection is weak). 



(A) (B) 


Figure 3. Fixation probability (A) and absorption time (B) versus initial vertex of mutant 
for the Moran process on the Frucht graph. In both figures, the mutant has htness r = 2 
relative to the wild type. As predicted by the Isothermal Theorem, the Hxation probability 
does not depend on the initial location of the mutant. The absorption time (measured in 
number of updates) is different for each initial placement of the mutant on the Frucht graph. 
The precise values of these fixation probabilities and absorption times are in Appendix C. 
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Example 1. Consider a symmetric matrix game with n strategies, Ai,..., An, and payoff matrix 

Ai 
A2 


If (si,..., Sat) € n}^, then the total payoff to player i is 

N 

^2 (^^1, • • • , ^ ^ ^ij ^SiSj ■ 

i=i 

If /3 ^ 0 is the intensity of selection, then the fitness of player i is 

fl3(ui (si,.. .,sn) ) := exp (si,.. .,sn) |- 


Ai 

to 

An 

ail 

012 

‘ ^In 

(^21 

022 

^2n 

^nl 

On2 

^nn 


( 3 ) 

( 4 ) 

( 5 ) 


In each time step, a player (say, player i) is chosen for reproduction with probability proportional to fitness. 
With probability £ ^ 0, the offspring of this player adopts a novel strategy uniformly at random from 
{Ai ,..., An}', with probability 1 — £, the offspring inherits the strategy of the parent. Next, another member 
of the population is chosen for death, with the probability of player j dying proportional to The 

offspring then fills the vacancy created by the deceased neighbor, and the process repeats. S’ is called the 
“interaction” graph since it governs payoffs based on encounters, and ^ is called the “dispersal” graph since 
it is involved in strategy propagation. 


3.2.1. Heterogeneous evolutionary games. We now explore the ways in which population structure and strat¬ 
egy mutations can introduce heterogeneity into an evolutionary process. Consider the Snowdrift Game with 
strategies C (cooperate) and D (defect) and payoff matrix 


C D 

C / 5 3\ 

D\ 7 0 )' 


( 6 ) 


Suppose that S and ^ are both the (undirected, unweighted) Frucht graph (see Fig. [^. If the selection 
intensity is /? = 1, then the fixation probability of a single cooperator in a population of defectors in a 
death-birth process depends on the initial location of the cooperator (Fig. |^. Since the Frucht graph is 
regular (but not vertex-transitive), this example demonstrates that the Isothermal Theorem does not extend 
to frequency-dependent games. In particular, symmetric games on regular graphs can be heterogeneous, 
and regularity of the graph does not imply that the “fixation probability of a randomly placed mutant” is 
well-defined. This dependence of the fixation probability on the initial location of the mutant is not specific 
to the Snowdrift Game or the death-birth update rule; one can show that it also holds for the Donation 
Game in place of the Snowdrift Game or the birth-death rule in place of the death-birth rule, for instance. 

With P = 1, the selection intensity is fairly strong, which raises the question of whether or not these 
fixation probabilities still differ if selection is weak. In fact, our observation for this value of P is not 
an anomaly: Suppose that s and s' are states (indicating some non-monomorphic initial configuration of 
strategies), and that Si and Sj are monomorphic absorbing states (indicating states in which each player uses 
the same strategy). Let denote the probability that state i is reached after starting in state s, and let 
denote the average number of updates required for the process to reach an absorbing state after starting in 
state s. Each of ps,i and may be viewed as functions of P, and we have the following result: 


Proposition 2. Each of the equalities 

P5,i ~ Pb'J'} C^^) 

ts = tj/ (7b) 

holds for either (i) every /3 ^ 0 or (ii) at most finitely many /3 ^ 0. Thus, if one of these equalities fails to 
hold for even a single value of /?, then it fails to hold for all sufficiently small /3 > 0. 
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Figure 4. Fixation probability (A) and absorption time (B) versus initial vertex of mutant 
(cooperator) for a death-birth process on the Frucht graph. In both figures, the game 
is a Snowdrift Game whose payoffs are described by payoff matrix § , and the selection 
intensity is /? = 1. Unlike the Moran process, this process is frequency-dependent, and 
it is evident that both fixation probabilities and absorption times (measured in number 
of updates) depend on the initial placement of the mutant. See Appendix C for details. 
Notably, the three vertices (7, 11, and 12) for which both fixation probability and absorption 
time are highest are the only vertices in the Frucht graph not appearing in a three-cycle. 


For a proof of Proposition!^ see Appendix A. This result allows one to conclude that if there are differences 
in fixation probabilities or times for large values of /3 (where these differences are more apparent), then there 
are corresponding differences in the limit of weak selection. 

Even if a symmetric game is played in a well-mixed population, heterogeneous strategy mutations may 
result in heterogeneity of the evolutionary process. Consider, for example, the pairwise comparison process 

) based on the symmetric Snowdrift Game, Q, in a well- 
mixed population with N = 3 players. We model this well-mixed population using a complete, undirected, 
unweighted graph of size 3 for each of S' and ^ (see Fig. [^. For i G {1,2,3}, let £i G [0,1] be the strategy- 
mutation (“exploration”) rate for player i. These strategy mutations are incorporated into the process as 
follows: At each time step, a focal player (player i) is chosen uniformly at random to update his or her 
strategy. A neighbor (one of the two remaining players) is then chosen randomly as a model player. If /3 is 
the selection intensity, TTf is the payoff of the focal player, and 7 r„i is the payoff of the model player, then the 
focal player imitates the strategy of the model player with probability 


(Szabo and Tdke 1998 Traulsen et al.| 2007 


1- £i 

1 _|_ e-/3(7i-m—n-f) ■ 

and chooses to retain his or her strategy with probability 

1 - gj 

1 _|_ e-/3(7I-f—TTm) ■ 


( 8 ) 

( 9 ) 


With probability £i, the focal player adopts a new strategy uniformly at random from the set {C,D}, 
irrespective of the current strategy. Provided at least one of ei, £ 2 , and £3 is positive, the Markov chain on 
{C,D}^ defined by this process is irreducible and has a unique stationary distribution, fi. Let £1 = 0.01 and 
£2 = £3 = 0. Since the mutation rate depends on the location, i, the strategy mutations are heterogeneous. 
If the selection intensity is /3 = 1, then a direct calculation (to four significant figures) gives 


(C, D, D) = 0.005812 ^ 0.0004897 = {D, C, D ), 


( 10 ) 
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Figure 5. Two states consisting of a single cooperator (mutant) among defectors (the 
wild type) in a well-mixed population of size TV = 3. Despite the spatial symmetry of 
this population, an evolutionary game on this graph can be heterogeneous as a result of 
heterogeneous strategy mutations or asymmetric payoffs. 


where {C, D, D) (resp. /i (D, C, D)) is the mass /r places on the state (C, D, D) (resp. (D, C, D)). Therefore, 
by Proposition and Definition this evolutionary process is not homogeneous, despite the fact that the 
population is well-mixed and the game is symmetric. This result is not particularly surprising, but it clearly 
illustrates the effects of hetergeneous strategy-mutation rates on symmetries of the overall process. 


3.2.2. Homogeneous evolutionary games. The behavior of an evolutionary process sometimes depends heav¬ 
ily on the choice of update rule. As a result, a particular problem in evolutionary game theory is often 
stated (such as the evolution of cooperation) and subsequently explored separately for a number of different 
update rules. For example, consider the Donation Game (an instance of the Prisoner’s Dilemma) in which 
cooperators pay a cost, c, in order to provide the opponent with a benefit, b. Defectors pay no costs and 
provide no benefits. On a large regular graph of degree k, Ohtsuki et al. (2006) show that selection favors 


cooperation in the death-birth process if 6/c > fc, but selection never favors cooperation in the birth-death 
process. Therefore, the approach of exploring a problem in evolutionary game theory separately for several 
update rules has its merits. On the other hand, one might expect that high degrees of symmetry in the pop¬ 
ulation structure, payoffs, and strategy mutations induce symmetries in an evolutionary game for a variety 
of update rules. 

Before stating our main theorem for symmetric matrix games, we must first understand the basic compo¬ 
nents that make up an evolutionary game. Evolutionary games generally have two timescales: interactions 
and updates. In each (discrete) time step, every player in the population has a strategy, and this strategy 
profile determines the state of the population. Neighbors then interact (quickly) and receive payoffs based 
on these strategies and the game(s) being played. The total payoff to a player determines his or her fitness. 
In the update step of the process, the strategies of the players are updated stochastically based on the 
fitness profile of the population, the population structure, and the strategy mutations. Popular examples of 
evolutionary update rules are birth-death, death-birth, imitation, pairwise comparison, and Wright-Fisher. 
Since interactions happen much more quickly than updates, there is a separation of timescales. 

The most difficult part of an evolutionary game to describe in generality is the update step. If S is the 
strategy set of the game and N is the population size, then a state of the population is simply an element 
of , i.e. a specification of a strategy for each member of the population. Implicit in the state space of 
the population being is an enumeration of the players. That is, if s G is an N-tuple of strategies, 
then this profile indicates that player i uses strategy s^. For our purposes, we need only one property to be 
satisfied by the update rule of the process, which we state here as an axiom of an evolutionary game: 


Axiom. The update rule of an evolutionary game is independent of the enumeration of the players. 

Remark 1. As an example of what this axiom means, consider a death-birth process in which a player is 
selected uniformly at random for death and is replaced by the offspring of a neighbor. A neighbor is chosen for 
reproduction with probability proportional to fitness, and the offspring of this neighbor inherits the strategy 
of the parent with probability 1 — e and takes on a novel strategy with probability e for some e > 0. If all 
else is held constant (fitness, mutations, etc.), the fact that a player is referred to as the player at location 
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i is irrelevant: Let ©at be the symmetric group on N letters. If tt G ©jv is a permutation that relabels the 
locations of the players by sending i to 7r“^ (i), then the strategy of the player at location 7r“^ (z) after the 
relabeling is the same as the strategy of the player at location i before the relabeling. In particular, if s G 
is the state of the population before the relabeling, then tt (s) G is the state of the population after the 
relabeling, where tt (s)^ = S 7 r(i)- The probability that player 7 r“^ (z) is selected for death and replaced by 
the offspring of player 7 r“^ (j) after the relabeling is the same as the probability that player i is selected for 
death and replaced by the offspring of player j before the relabeling. Thus, for this death-birth process, the 
probability of transitioning between states s and s' before the relabeling is the same as the probability of 
transitioning between states tt (s) and tt (s') after the relabeling. In this sense, a relabeling of the players 
induces an automorphism of the Markov chain defined by the process (in the sense of Definition , and the 
axiom states that this phenomenon should hold for any evolutionary update rule. 


In order to state our main result for symmetric games, we note that an evolutionary graph, T, in this 
setting consists of two graphs: S' and 2i. We say that T is regular if both S and ^ are regular. For vertex- 
transitivity of r (resp. symmetry of F), we require slightly more than each S and ^ being vertex-transitive 
(resp. symmetric); we require them to be simultaneously vertex-transitive (resp. symmetric). First of all, we 
need to define what an automorphism of F is. For tt G &n, let ttS be the graph defined by {ttS)^j := 
for each z and j. Using this action, we dehne an automorphism of an evolutionary graph as follows: 

Definition 4 (Automorphism of an evolutionary graph). An automorphism of F = (S,^) is an action, 
TT G ©jv, such that ttS = S and tt.^ = ^. We denote by Aut (F) the set of automorphisms of F. 

We now have the dehnitions of vertex-transitive and symmetric evolutionary graphs: 

Definition 5. F = (S^ .^) is vertex-transitive if for each z and j, there exists tt G Aut (F) such that tt (z) = j. 

Definition 6. F = {S^ ^) is symmetric \i S = ^ and S is a symmetric graph. 

Finally, using the notion of an automorphism of F, we have our main result: 

Theorem 1. Consider an evolutionary matrix game on a graph, F = (S,S>), with symmetric payoffs and 
homogeneous strategy mutations. If tt G Aut (F), then the states with a single mutant at vertex i and tt (z), 
respectively, in an otherwise-monomorphic population, are evolutionarily equivalent. That is, in the notation 
of Definition!^ the states and S(s', 7 r(i)),s are evolutionarily equivalent for each s,s' G S. 

The proof of Theorem may be found in Appendix B. The proof relies on the observation that the 
hypotheses of the theorem imply that any two states consisting of a single A-player in a population of B- 
players can be obtained from one another by relabeling the players. Thus, in light of the argument in Remark 
[2 relabeling the players induces an automorphism on the Markov chain defined by the evolutionary game. 
Since any relabeling of the players leaves the monomorphic states fixed, there is an evolutionary equivalence 
between any two such states in the sense of Definition Note that this theorem makes no restrictions on 
the selection strength or the update rule. 


Corollary 1. An evolutionary game on a vertex-transitive graph with symmetric payoffs and homogeneous 
strategy mutations is itself homogeneous. 


Remark 2. By Theorem two mutants appearing on a graph might define evolutionarily equivalent states 
even if the graph is not vertex-transitive. For example, the Tietze graph (see Bondy and Murty 20081, like 
the Frucht graph, has 12 vertices and is regular but not vertex-transitive. However, unlike the Frucht graph, 
the Tietze graph has some nontrivial automorphisms. By Theorem any two vertices in the Tietze graph 
that are related by an automorphism have the property that the two corresponding single-mutant states 
are indistinguishable. An example of two evolutionarily equivalent states on this graph is given in Fig. 

In Appendix C, for the Snowdrift Game with death-birth updating, we give the fixation probabilities and 
absorption times for all configurations of a single cooperator among defectors, which further illustrates the 
effects of graph symmetries on an evolutionary process. 


Remark 3. For a given population size, N, and network degree, fc, there may be many vertex-transitive 
graphs of size N with degree k. For each such graph, the fixation probability of a randomly occuring mutant 
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Figure 6. The Tietze graph with two different initial configurations. Like the Frucht graph, 
the Tietze graph is regular of degree fc = 3 (but not vertex-transitive) with TV = 12 vertices. 
Unlike the Frucht graph, the Tietze graph possesses nontrivial automorphisms. In (A), a 
cooperator is at vertex 6 and all other players are defectors. In (B), a cooperator is at 
vertex 11 and, again, the other players are defectors. Despite the fact that the Tietze graph 
is not vertex-transitive, the single-mutant states defined by (A) and (B) are evolutionarily 
equivalent. Graphically, this result is clear since one obtains (A) from (B) by flipping the 
graph (i.e. applying an automorphism), and such a difference between the two states does 
not affect fixation probabilities, times, etc. However, it is not true that any two single-mutant 
states are evolutionarily equivalent. For example, in the Snowdrift Game with /3 = 0.1 and 
death-birth updating, the single-mutant state with a cooperator at vertex 1 (resp. vertex 6) 
has a fixation probability of 0.3777 (resp. 0.4186). Therefore, the two single-mutant states 
with cooperators at vertices 1 and 6, respectively, are not evolutionarily equivalent, so this 
process is not homogeneous. 


is independent of where on the graph it occurs by TheoremHowever, this fixation probability depends on 
more than just N and k; it also depends on the configuration of the network. For example. Fig. gives two 
vertex-transitive graphs of size N = 6 and degree k = 3. As an illustration, consider the Snowdrift Game 
(with payoff matrix on these graphs with birth-death updating. If the selection intensity is /3 = 0.1, 
then the fixation probability of a single cooperator in a population of defectors is 0.1632 in (A) and 0.1722 
in (B) (both rounded to four significant figures). These two fixation probabilities differ for all but finitely 
many /3 ^ 0 by Proposition]^ 

Until this point, our focus has been on states consisting of just a single mutant in an otherwise-monomorphic 
population. One could also inquire as to when any two states consisting of two (or three, four, etc.) mutants 
are evolutionarily equivalent. It turns out that that the answer to this question is simple: in general, the 
population must be well-mixed in order for any two m-mutant states to be evolutionarily equivalent if m > 1. 
The proof that this equivalence holds in well-mixed populations follows from the argument given to establish 
Theorem]^ (see Appendix B). On the other hand, if the population is not well-mixed, then one can find a 
pair of states with the first state consisting of two mutants on neighboring vertices and the second state con¬ 
sisting of two mutants on non-neighboring vertices. In general, the mutant type will have different fixation 
probabilities in these two states. For example, in the Snowdrift Game on the graph of Fig. [^B), consider the 
















Figure 7. Undirected, unweighted, vertex-transitive graphs of degree fc = 3 with N = 6 
vertices. (B) is a symmetric (arc-transitive) graph and (A) is not. 


two states, s and s', where s consists of cooperators on vertices 1 and 2 only and s' consists of cooperators 
on vertices 1 and 3 only. If ,5 = 0.1, then the fixation probability of cooperators under death-birth updating 
when starting at s (resp. s') is 0.3126 (resp. 0.2607). Therefore, despite the arc-transitivity of this graph, 
it is not true that any two states consisting of exactly two mutants are evolutionarily equivalent. Only in 
well-mixed populations are we guaranteed that any two such states are equivalent. 


3.3. Asymmetric games. One particular form of payoff asymmetry appearing in evolutionary game theory 


is ecological asymmetry (McAvoy and Hauert 2015b). Ecological asymmetry can arise as a result of an uneven 


distribution of resources. For example, in the Donation Game, a cooperator at location i might provide a 
benefit to his or her opponent based on some resource derived from the environment. Both this resource and 
the cost of donating it could depend on i, which means that different players have different payoff matrices. 
These payoff matrices depend on both the location of the focal player and the locations of the opponents. 
Thus, payoffs for a player at location i against an opponent at location j in an n-strategy “bimatrix” game 


(Hofbauer 1996 Ohtsuki 2010 McAvoy and Hauert 2015b) are given by the asymmetric payoff matrix 


Ai 


= 


Ai 

A 2 


^3 


®211 ®12 






®22i ®22 


An 




\\ 


A \ ij ji ij ji 

An \ <l,am <2>«2n 


^2n’> ^n2 


^nn'f ^nn / 


( 11 ) 


Similar to Eq. M, the total payoff to player i for strategy profile (si,..., sat) G {1,..., n}^ is 


N 


■ ■ ■ 5 ^n') ■— ^ 

1 = 1 




( 12 ) 


We saw in §3.2| an example of a heterogeneous evolutionary game in a well-mixed population with sym¬ 
metric payoffs. Rather than looking at a symmetric game with heterogeneous strategy mutations, we now 
look at an asymmetric game with homogeneous strategy mutations. Consider the ecologically asymmetric 
Donation Game on the graph of Fig. (both S’ and with a death-birth update rule. In this asymmetric 
Donation Game, a cooperator at location i donates bi at a cost of Ci; defectors donate nothing and incur 
no costs. If /3 = 0.1, 61 = 62 = ^3 = 4, Ci = 1, and 02=03 = 3, then the fixation probability of a single 
cooperator at location 1 (see Fig. [^A)) is 0.2232, while the fixation probability of a single cooperator at 
location 2 (see Fig. [^B)) is 0.1842 (both rounded to four significant hgures). Therefore, even in a well-mixed 
population with homogeneous strategy mutations (none, in this case), asymmetric payoffs can prevent an 
evolutionary game from being homogeneous. 
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Asymmetric matrix games in large populations reduce to symmetric games if selection is weak (McAvoy 


and Hauert 2015b). In the limit of weak selection, McAvoy and Hauert (2015a) establish a selection 


condition for asymmetric matrix games in finite graph-structured populations that extends the condition 


(for symmetric games) of Tarnita et al. (2011): 


Theorem 2 (McAvoy and Hauert 
independent o 


(2015a)). There exists a set of structure coefficients, 
payoffs, such that weak selection favors strategy r S {1 ,..., n} if and only if 




'2 : ^3 


N 


> 0 , 


}. > 


(13) 


ij = l 


where Tjb — i V” ob Tjb — i V" ob 77b — i V" ob and ob — J_ V” 
wueie a** — ^ 2^s=l “ssj “r* — n Z^s=l “rsj “♦r — n Z^s=l “srJ Z^s,t=l “st- 

Strictly speaking. Theorem is established for S and ^ undirected, unweighted, and satisfying S = ^. 
However, the proof of Theorem extends immediately to the case with S and ^ directed, weighted, and 
possibly distinct, so we make no restrictive assumptions on S and S) in the statement of this theorem here. 
In the simpler case n = 2, condition takes the form 

N 


'^b 

i,i=l 


rb (r 


+ - 2 ^ 


(012-02^1)) > 0 


for some collection 


^ J 1,1 


For the death-birth process with S’ and ^ the graph of Fig. 


(14) 


A), we 


calculate exact values for all of these structure coefficients (see Appendix C). In particular, we find that 
= 707905/9315552 and = 16291/194074, so vertex-transitivity does not guarantee that the structure 
coefficients are independent of i and j. For the same process on the graph in Fig. SB) , we find that 
= T 2 = 2189/27728 for each i and j, so these coefficients do not depend on i and j. (In general, even for 
well-mixed populations, ri and T 2 need not be the same; for the same process studied here but on the graph 
of Fig. = 33/1616 and = 99/1616 for each i and j.) This lack of dependence on i and j is due to 

the fact that the graph of Fig. SB) is symmetric, and it turns out to be a special case of a more general 
result: 


Theorem 3. Suppose that an asymmetric matrix game with homogeneous strategy mutations is played on 
an evolutionary graph, F = [S, ^). For each tt G Aut (F), k G {1, 2, 3}, and i, j G {1,..., A^}, 


b _ 


(15) 


The proof of Theoremj^may be found in Appendix B. The following corollary is an immediate consequence 
of Theorem |3l 


Corollary 2. If ^ ^ and (o’ is a symmetric graph (i.e. F is a symmetric evolutionary graph), then the 

structure coefficients are independent of i and j. 


Since symmetric graphs are also regular, we have: 

Corollary 3. If (^ = ^ and S' is a symmetric graph (i.e. F is a symmetric evolutionary graph), then strategy 
r is favored in the limit of weak selection if and only if 

(Jl (Urr — a**) + 1 X 2 (ttr* — a*r) + O's (Or* — o) > 0, (16) 

where M = {ast)i^s spatial average of the matrices Mb, i.e. 

_ 1 ^ 

“ M If (1^) 


where k is the degree of the graph, F. 


Remark 4. Eq. (16) is just the selection condition of Tarnita et al. (2011) for symmetric matrix games. 

It follows from Corollary that asymmetric matrix games on arc-transitive (symmetric) graphs can be 
reduced to symmetric games in the limit of weak selection. 
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4. Discussion 


Evolutionary games in finite populations may be split into two classes: those with absorbing states 
(“absorbing processes”) and those without absorbing states. In absorbing processes, the notion of fixation 
probability has played a crucial role in quantifying evolutionary outcomes, but fixation probabilities are far 
from the only measure of evolutionary success. Much of the literature on evolutionary games with absorbing 
states has neglected other metrics such as the time to absorption or the time to fixation conditioned on 
fixation occurring (“conditional fixation time”). This bias toward fixation probabilities has resulted in 
certain evolutionary processes appearing more symmetric than they actually are. We have illustrated this 
phenomenon using the frequency-independent Moran process on graphs: The Isothermal Theorem guarantees 
that, on regular graphs, a single mutant cannot distinguish between initial locations in the graph if the only 
metric under consideration is the probability of fixation. However, certain initial placements of the mutant 
may result in faster absorption times than others if the graph is regular but not vertex-transitive, and the 
Frucht graph exemplifies this claim. The same phenomenon also holds for conditional fixation times. 

The Frucht graph, which is a regular structure with no nontrivial symmetries (there are no two vertices 
from which the graph “looks” the same), also allowed us to show that the Isothermal Theorem of Lieberman 


et al. (2005) does not extend to frequency-dependent evolutionary games. That is, on regular graphs, the 


probability of fixation of a single mutant may depend on the initial location of the mutant if fitness is 
frequency-dependent. This claim was illustrated via a death-birth process on the Frucht graph, in which the 
underlying evolutionary game was a Snowdrift Game. For /3 = 1 (strong selection), the fixation probability 
of a cooperator at vertex 11 was nearly 14% larger than the fixation probability of a cooperator at vertex 4. 
Moreover, we showed that if the fixation probabilities of two initial configurations differ for a single value of (3, 
then they are the same for at most finitely many values of /3. In particular, these fixation probabilities differ 
for almost every selection strength, so our observation for (3 = 1 was not an anomaly. Similar phenomena 
are observed for frequency-dependent birth-death processes on the Frucht graph, for example, and even for 
frequency-dependent games with the “equal gains from switching” property, such as the Donation Game. 

Theorem is an analogue of the Isothermal Theorem that applies to a broader class of games and update 
rules. The Isothermal Theorem is remarkable since regularity of the population structure implies that the 
fixation probabilities are not only independent of the initial location of the mutant, they are the same as 
those of the classical Moran process. Our treatment of homogeneous evolutionary processes is focused on 
when different single-mutant states are equivalent, not when they are equivalent to the corresponding states 
in the classical Moran process. Even if the fixation probability of a single mutant does not depend on the 
mutant’s location, other factors (such as birth and death rates) may affect whether or not this fixation 


probability is the same as the one in a well-mixed population (Komarova 2006 Kaveh et al. 2015). Remark 


which compares the fixation probabilities for the Snowdrift Game on two different vertex-transitive graphs 
of the same size and degree, shows that the fixation probability of a single mutant-even if independent of 
the mutant’s location-can depend on the configuration of the graph. In light of these results, the symmetry 
phenomena for the Moran process guaranteed by the Isothermal Theorem do not generalize and should be 
thought of as properties of the frequency-independent Moran process and not of evolutionary processes in 
general. 

Theorem and indeed most of our discussion of homogeneity, focused on symmetries of states consisting 
of just a single mutant. In many cases, mutation rates are sufficiently small that a mutant type, when it 


appears, will either fixate or go extinct before another mutation occurs (Fudenberg and Imhof 2006 Wu 


et al. 2011). Thus, with small mutation rates, one need not consider symmetries of states consisting of more 


than one mutant. However, if mutation rates are larger, then these multi-mutant states become relevant. Our 
definition of evolutionary equivalence (Definition]^ applies to these states, but, as expected, the symmetry 
conditions on the population structure guaranteeing any two multi-mutant states are equivalent are much 
stronger. In fact, as we argued in §3.2.2[ the population must in general be well-mixed even for any pair of 
states consisting of two mutants to be evolutionarily equivalent. Consequently, our focus on single-mutant 
states allowed us to simultaneously treat biologically relevant configurations (assuming mutation rates are 
small) and obtain non-trivial conditions guaranteeing homogeneity of an evolutionary process. 

The counterexamples presented here could be defined on sufficiently small population structures, and 
thus all calculations (fixation probabilities, structure coefficients, etc.) are exact. However, these quantities 
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need not always be explicitly calculated in order to prove useful: In our study of asymmetric games, we 
concluded that an asymmetric game on an arc-transitive (symmetric) graph can be reduced to a symmetric 
game in the limit of weak selection. (The graph of Fig. BA) demonstrates that vertex-transitivity alone 
does not guarantee that an asymmetric game can be reduced to a symmetric game in this way.) This result 
was obtained by examining the qualitative nature of the structure coefficients in the selection condition 
(13), but it did not require explicit calculations of these coefficients. Therefore, despite the difficulty in 


actually calculating these coefficients, they can still be used to glean qualitative insight into the dynamics of 
evolutionary games. 

On large random regular graphs, the dynamics of an asymmetric matrix game are equivalent to those of 
a certain symmetric game obtained as a “spatial average” of the individual asymmetric games (McAvoy and 
Hauert 2015b[ ). Corollary is highly reminiscent of this type of reduction to a symmetric game. For large 
populations, this result is obtained by observing that large random regular graphs approximate a Bethe 
lattice (Bollobas] |2001[) and then using the pair approximation method (Matsuda et ah, 1992) to describe 


the dynamics. The pair approximation method is exact for a Bethe lattice (Ohtsuki et al. 2006), so, from 


this perspective. Corollary is not that surprising since Bethe lattices are arc-transitive. Of course, a Bethe 
lattice has infinitely many vertices, and Corollary is a finite-population analogue of this result. 

The term “homogeneous” is used in the literature to refer to several different kinds of population struc¬ 


tures. This term has been used to describe well-mixed populations (Assaf and Mobilia 2012 Szolnoki et al. 


2014). For graph-structured populations, “homogeneous graph” sometimes refers to vertex-transitive graphs 


(Taylor et al. 2007 Tarnita and Taylor 2014). In algebraic graph theory, however, the term “homogeneous 


graph” implies a much higher degree of symmetry than does than vertex-transitivity (see Beineke et al. 
2004). “Homogeneous” has also been used to describe graphs in which each vertex has the same number of 
neighbors, i.e. regular graphs (Roca et al. 2009 Hindersin and Traulsen 2014 Cheng et al. 2015). In be¬ 


tween regular and vertex-transitive graphs, “homogeneous graph” has also referred to large, random regular 


graphs (Traulsen et al. 2009). As we noted, large, random regular graphs approximate Bethe lattices (which 
are infinite, arc-transitive graphs), but these approximations need not themselves be even vertex-transitive. 

In many of the various uses of the term “homogeneous,” a common aim is to study the fixation probability 
of a randomly placed mutant. Our definition of homogeneous evolutionary game formally captures what it 
means for two single-mutant states to be equivalent, and our explorations of the Frucht graph (in conjunction 
with Theorem]^ show that vertex-transitivity, and not regularity, is what the term “homogeneous” in graph- 
structured populations should indicate. We also demonstrated the effects of payoffs and strategy mutations 
on the behavior of these single-mutant states and concluded that the term homogeneous should apply to the 
entire process rather than to just the population structure. The homogeneity (Theorem and symmetry 
(Theorem results given here do not depend on the update rule, in contrast with results such as the 
symmetry of conditional fixation times in the Moran process of Taylor et al.| ( |2006[ ) or the Isothermal 
Theorem of Lieberman et al. (2005). We now know that games on regular graphs are not homogeneous, 


and we know precisely under which conditions the “fixation probability of a randomly placed mutant” is 
well-defined. These results provide a firmer foundation for evolutionary game theory in finite populations 
and a basis for defining the evolutionary success of the strategies of a game. 
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Appendix A: fixation and absorption 


Using a method inspired by a technique of Press and Dyson (20121, we derive explicit expressions (in 
terms of the transition matrix) for fixation probabilities and absorption times. Subsequently, we prove a 
simple lemma that says that Markov chain symmetries preserve the set of a chain’s stationary distributions. 


A.l. Fixation probabilities. Suppose that {Xn]n>G discrete-time Markov chain on a finite state space, 
§, that has exactly K (^ 1) absorbing states, 5i,... ,Sk- Moreover, suppose that the non-absorbing states 
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are transient (see Fudenberg and Imhof 2006). The transition matrix for this chain, T, may be written as 


T = 


Ik 

Si 


0 

S2 


(A.l) 


where Ix is the KxK identity matrix and 0 is the matrix of zeros (in this case, its dimension is Kx (|§| — K), 
where |§| is the number of states in §). This chain will eventually end up in one of the K absorbing states, 
and we denote by the probability that state Si is reached when the chain starts off in states s G §. Let 
P be the |§| x K matrix of fixation probabilities, i.e. Ps,i = for each s and i. This matrix satisfies 


TP = P, 


(A.2) 


which is just the matrix form of the recurrence relation satisfied by fixation probabilities (obtained from a 
“first step” analysis of the Markov chain). Consider the matrix, M = M (T), defined by 


M := - 

Since pjy = Sij for i,j G {!,..., K}, we see that 

-MP = TP - 


Ik 

Si 


S2 — I|S|-if 




P = 


Ik 

0 


(A.3) 


(A.4) 


Moreover, the matrix M must have full rank since the non-absorbing states are transient; that is, 

det M = (-1)'®' det (S 2 - I|s|_if) ^ 0. 

Therefore, by Cramer’s rule, 

detM(s,ei) 

“ detM ’ 

where the notation M(s,ei) means the matrix obtained by replacing the column corresponding to state s 
with the ith standard basis vector, e^. Thus, Eq. (A.6) gives explicit formulas for the fixation probabilities. 


(A.5) 


(A.6) 


A.2. Absorption times. Let t be the |§|-vector indexed by § whose entry t^ is the expected time until the 
process fixates in one of the absorbing states when started in state s G §. This vector satisfies t^ = 0 for 
i = 1,..., K as well as the recurrence relation T (t -f 1) = t -b Therefore, 

|S| 

Mt = ^ Bj, (A.7) 

j=K+l 


so, by Cramer’s rule, 


ts 


|S| 

E 


j=K+l 


detM(s,ej) 

detM 


(A.8) 


We now turn to Markov chains defined by evolutionary games. Before proving Proposition we make 
two assumptions: 

(i) The payoff-to-fitness mapping is of the form fp (tt) = exp{/37r}, fp (tt) = /Jtt, fp (tt) = 1 -|- ^Stt, or 
//3 (t’") = 1 — /3 + /^TT, where /3 denotes the intensity of selection and tt denotes payoff. (Of course, 
fitness can be defined in one of the latter three ways only if the payoffs are such that fp (tt) ^ 0.) 

(ii) The update probabilities are rational functions of the fitness prohle of the population. 


Remark 5. Assumptions (i) and (ii) are not at all restrictive in evolutionary game theory. Any process 
in which selection occurs with probability proportional to fitness will satisfy this rationality condition, and 
indeed all of the standard evolutionary processes (birth-death, death-birth, imitation, pairwise comparison, 
Wright-Fisher, etc.) have this property. The four payoff-to-fitness mappings are standard as well. 


With assumptions (i) and (ii) in mind, we have: 
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Proposition Each of the equalities 


PB,i — Pb', jl 

tfi = tfi/ 


(A.9a) 
(A.9b) 

holds for either (i) every /3 ^ 0 or (ii) at most finitely many /3 ^ 0. Thus, if one of these equalities fails to 
hold for even a single value of /3, then it fails to hold for all sufficiently small /3 > 0. 


Proof. Suppose that s,s' S § and that Si and Sj are absorbing states. By Eq. (A.6), 


Ps.i — Ps^j 


detM(s,ei) detM(s',ej) 
det M det M 

det M (s, Bi) = det M (s', Bj). 


(A.IO) 


Similarly, by Eq. (A.8), 


detM {s,Bj) 
det M 


|S| 

E 

j = K+l 

|S| 

uerJvnSjCj, 
j = K+l j=K+l 


detM(s, Oj) = 


|S| 

^ E 

j^K+l 

|S| 


detM (s',ej) 
detM 


detM(s',ej). 


(A.ll) 


Assuming (i) and (ii), Eqs. (A.IOI and (A.ll) are equivalent to polynomial equations in either /3 or exp{/3}. 
Either way, since nonzero polynomial equations have at most finitely many solutions, we see that the equalities 
Ps,i = Pb'j and tj = tj/ each hold for either (i) every /3 or (ii) finitely many values of /3. Thus, if ^ 
(resp. tj ^ tj/) for even a single selection intensity, then these fixation probabilities (resp. absorption times) 
differ for almost every selection intensity. In particular, they differ for all sufficiently small /3. □ 


Appendix B; symmetry and evolutionary equivalence 

B.l. Symmetries of graphs. Here we recall some standard notions of symmetry for graphs. Although we 
treat directed, weighted graphs in general, throughout the main text we give several examples of wndirected 
and unweighted graphs, which are dehned as follows: 

Definition 7 (Undirected graph). A graph, is undirected if = ^ji for each i and j. 

Definition 8 (Unweighted graph). A graph, is unweighted if G {0,1} for each i and j. 

Since our goal is to discuss symmetry in the context of evolutionary processes, we first describe several 
notions of symmetry for graphs. In a graph, the indegree and outdegree of vertex i are Tl!j=i 
respectively. With these definitions in mind, we recall the definition of a regular graph: 

Definition 9 (Regular graph). ^ is regular if and only if there exists k G M. such that 

N N 

= (B.l) 

i=i 

for each i. If ^ is regular, then k is called the degree of 

Let &N denote the symmetric group on N letters; that is, ©at is the set of all bijections tt : {1,..., A^} —>• 
A^}. Each tt G &n extends to a relabeling action on the set of directed, weighted graphs defined by 
(tt^)-^- = ^,r(i) 7 i-(j)- In other words, any relabeling of the set of vertices results in a corresponding relabeling 
of the graph. The automorphism group of written Aut (^), is the set of all tt e ©at such that 
We now recall a condition slightly stronger than regularity known as vertex-transitivity: 

Definition 10 (Vertex-transitive graph). ^ is vertex-transitive if for each i and j, there exists tt G Aut 
such that TT {i) = j. 

Informally, a graph is vertex-transitive if and only if it “looks the same” from every vertex. If a graph is 
vertex-transitive, then it is necessarily regular. The strongest form of symmetry for graphs that we consider 
here is the following: 


19 










Definition 11 (Symmetric graph). ^ is symmetric (or arc-transitive) if for each i,j with ^ 0 and i',j' 
with ^iiji ^ 0, there exists tt G Aut (^) such that tt {i) = i! and tt (j) = j'. 

A graph is symmetric if it “looks the same” from any two directed edges. Arc-transitivity is typically 
defined for unweighted graphs, i.e. graphs satisfying ^ G {0, 1}^^'^. For the more general class of weighted 
graphs, we require that ©at act transitively on the set of edges of where “edge” means a pair (i, j) with 
Qlij ^ 0. Thus, all of the edges in a symmetric, weighted graph have the same weight: otherwise, if (z,j) 
and are edges but !^ij ^ then there would exist no permutation, tt, sending i to z', j to j', 

and preserving the weights of the graph. Therefore, since the weights of a symmetric graph take one of two 
values (0 or else the only nonzero weight), such a graph is essentially unweighted. 

B.2. Symmetries of evolutionary processes. In §2.1[ we defined two states, s and s', to be evolutionarily 
equivalent if (i) there exists an automorphism of the Markov chain, (j) G Aut (Al), such that 4> (s) = s', and (ii) 
this automorphism satisfies ^ (/r) = /i for each stationary distribution, /i, of the chain. Condition (i), which 
means that s and s' are symmetric, alone is not quite strong enough to guarantee that s and s' have the 
same long-run behavior. To give an example of a symmetry of states that is not an evolutionary equivalence, 
we consider the neutral Moran process in a well-mixed population of size N = 3: 


Example 2. In a well-mixed population of size N = 3, consider the (frequency-independent) Moran process 
with two types of players: a mutant type and a wild type. Suppose that the mutant type is neutral with 
respect to the mutant; that is, the fitness of the mutant relative to the wild type is 1. Since the population 
is well-mixed, the state of the population is given by the number of mutants it contains, i G {0,1, 2,3} =: §. 
Consider the map ((>:§—)■§ defined by 0 (z) = 3 — z. States 0 and 3 are absorbing, and, for z G {1, 2}, the 
transition probabilities of this process are as follows: 


Tiy-i 

T.y 



(B.2a) 


(B.2b) 


It follows at once that (j) preserves these transition probabilities, so 4> is an automorphism of the Markov 
chain. Let pi be the probability that mutants fixate given an initial abundance of z mutants. The states 1 
and 2 are symmetric since </> (1) = 2, but it is not true that pi = p 2 since pi = 1/3 and p 2 = 2/3. The reason 
for this difference in fixation probabilities is that states 1 and 2, although symmetric, are not evolutionary 
equivalent since swaps the two absorbing states of the process. 


In contrast to Example processes with unique stationary distributions have the property that every sym¬ 
metry of the Markov chain is an evolutionary equivalence (Proposition]^. The following lemma establishes 
Proposition 

Lemma 1. If </:§—>§ is a symmetry of a Markov chain and /i is a stationary distribution of this chain, 
then (j) (p) is also a stationary distribution. In particular, if p is unique, then (j) (p) = p. 


Proof. If T is the transition matrix of this Markov chain, then 

■</(p)"'t 1 =^0(p)^,T,y, 

^ s'GS 

s'GS 

s'GS 

= 

= ^ 

SO (j) (p)^ T = (j) (p)^, which completes the proof. 


which completes the proof. 
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(B.3) 

□ 






We turn now to the proofs of our main results (Theorems and : 

Theorem Consider an evolutionary matrix game on a graph, T = (^, ^), with symmetric payoffs and 
homogeneous strategy mutations. If tt S Aut (T), then the states with a single mutant at vertex i and tt (i), 
respectively, in an otherwise-monomorphic population, are evolutionarily equivalent. That is, in the notation 
of Definition!^ the states S(s',i),s and are evolutionarily equivalent for each s,s' S S. 

Proof. The state space of the Markov chain defined by this evolutionary game is , where S is the strategy 
set and N is the population size. For tt G Aut(r), let tt act on the state of the population by changing 
the strategy of player i to that of player tt~^ {i) for each i = 1,..., N. In other words, tt sends s G to 
TTS G , which is defined by (tts)- = s^-i(i) for each i. Therefore, for s, s’ G S, we have 

~ ^(s' ,7r(i)),s (^A) 

for each i = 1,..., JV. Since tt is an automorphism of the evolutionary graph, T, we have TT(f = S and 
tt3j = Sj. Moreover, tt preserves the strategy mutations since they are homogeneous. Since the payoffs 
are symmetric, tt just rearranges the fitness profile of the population: the payoff of player i becomes the 
payoff of player tt~^ (i) (see Eq. @)- so the same is true of the fitness values. Therefore, applying the map 
TT to is equivalent to applying the map on obtained by simply relabeling the players. Since any 
such relabeling of the players results in an automorphism of the Markov chain on that preserves the 
monomorphic absorbing states, it follows that S(s',i),s and S(s',-n-(i)),s are evolutionarily equivalent. □ 


Theorem Suppose that an asymmetric matrix game with homogeneous strategy mutations is played on 
an evolutionary graph, T = {S', ^). For each tt G Aut (T), k G {1, 2, 3}, and i,j G {!,..., A^}, 


ij _ Tr(i)Tr(j) 


(B.5) 


Proof. Let T be the transition matrix for the Markov chain defined by this process. Since there are nonzero 
strategy mutations, this chain has a unique stationary distribution, /r. The matrix T defines a directed, 
weighted graph on |S| = \S\^ vertices that has an edge from vertex s to vertex s' if and only if ^ 0. If 
there is an edge from s to s', then the weight of this edge is simply Ts^^/. The (outdegree) Laplacian matrix 


of this graph, L = L (T), is defined by £ = /|s| — T (see Chung 1996). In terms of this Laplacian matrix, 
Press and Dyson (2012) show that for any vector, i/, the stationary distribution satisfies 


det L (s, v) 

for each state, s, where L (s, v) denotes the matrix obtained from L by replacing the column corresponding 
to state s by v. Thus, if V'r is the vector indexed by § = with fTr (s) being the frequency of strategy r 
in state s, then the average abundance of strategy r is 

det L (s, ipr) 


F.y. ■= fJ- ■ '4^r = 


(B.7) 


Since T is a function of the payoffs, a = (ogt) 




det L (s, 1) 

we may write = F^. (a), (a is just an ordered tuple 


defined by := a'j for each s, t, i, and j.) Moreover, since the entries of T are assumed to be smooth 


functions of a (see |Tarnita et ah 2011), Fj. is also a smooth function of a by Eq. (B.7) and the definition of 
L. We will show that for each s and t. 


dFr 


dali 


dFr 


a=0 


da^Jd-U) 


(B.8) 


a=0 


for each i and j. The theorem will then follow from the derivations of a’f , a'f , and in (McAvoy and 


Hauert 


2015a) since it is shown there that each is a function of the elements in the set 

f dFr 




(B.9) 
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s,t=l 


























For s, t, i, and j fixed and a e K, let (a) be the function of the vector with a at entry and 0 in 

all other entries. Symbolically, if Sx,y is defined as 1 if x = y and 0 otherwise and 




(a) •— s^i^J) g/ 


(B.IO) 


then 


(a) := Fx 



(B.ll) 


Let TT S 6jv and suppose that tt G Aut (F); that is, TVS' = S and tt^ = ^. tt induces a map on the payoffs, 
a, defined by tt (a%j = ■ Let orbg^ (a) denote the orbit of a under this action, and 

consider the enlarged state space S' := x orbe^^ (a). Using the Markov chain on coming from the 
evolutionary process, we obtain a Markov chain on x orbe^ (^) via the transition matrix, T', defined by 


TUb).(.'.b') :=4,b'T,,,,(b). (B.12) 

for s,s' G and b, b' G orbsw (^)- (We write T (b) to indicate the transition matrix as a function of the 
payoff values of the game.) tt extends to a map on S' defined by tt (s, b) = (tts, 7 rb). Since tt preserves S’, 
and the strategy mutations (since they are homogeneous), it follows that the induced map tt : S' —?► S' is an 
automorphism of the Markov chain on S' defined by T'. If p,' is a stationary distribution for the chain T', 
then, for each s G and b G orbew (^)j 


A(,,b) 


E 


E 


F(6'.b') 


T 


(6',b').(5,b) 


s'GS” b'Gorbejy(a) 


E! E! F(s'.b')'^t>',bT5'^s 

s'GS” b'Gorbe„(a) 


E F(s',b)Ts'.s- 

s'GS« 


(B.13) 


It then follows from the uniqueness of /x = ^ (b) that there exists (b) > 0 such that = c^/ (b) ^ 5 . 

If /x' is such a stationary distribution, then, by Lemma tt/x' = /x" for some other stationary distribution, 
/x", of the chain on S'. This equation implies that c^" (b) = c^' (xrb) for each b G orbe„ (^)- Therefore, 

TT/x (xrb)^ =/i (xrb)^^ = ^ (b)^ (B.14) 

for each s G and b G orbsw (a)- Consequently, since = 4’r, 

(a) = Fx (a)) 

= F (a)) • V'r 

= TT/x (a)^ • -ipr 

= (a)) • TTIpr 

= Fr (a)) 

= (a). (B.15) 


As a result, we have 



d 

da 


ps,t,i,3 

r 

a—Q 


d 

da 


ps,t,Tr{i),Tr{j) 

± r 

a =0 


dFr 


a=0 


(B.I 6 ) 

□ 


so Eq. (B.8) holds, which completes the proof. 
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initial vertex of mutant 

absorption time 

1 

238.1836 

2 

237.0596 

3 

234.5982 

4 

235.8447 

5 

236.5967 

6 

234.5792 

7 

231.6988 

8 

238.0375 

9 

233.6122 

10 

235.1514 

11 

230.1340 

12 

228.7114 


Table 1. The absorption times of the 12 initial configurations of a single mutant in a 
wild-type population for the Moran process on the Frucht graph. The fitness of the mutant 
relative to the wild type is r = 2. 


Appendix C: explicit calculations 


We now perform explicit calculations using Eqs. and ( |A. 8 [ ) to show that the Isothermal Theorem 

extends to neither absorption times nor frequency-dependent games. We also calculate the structure coeffi¬ 
cients for the death-birth process on the graph of Fig. [^A) to show that Corollary does not necessarily 
hold for graphs that are vertex-transitive but not symmetric. 

C.l. The Moran process. Consider the Moran process on the Frucht graph (Fig. [^, and suppose that 
the mutant type has fitness r > 0 relative to the wild type. By the Isothermal Theorem of |Lieberman et al 
(2005), the fixation probability of a fixed number of mutants is independent of the configuration of those 


mutants on the graph. For r = 2, the absorption times (of configurations of a single mutant in a wild-type 
population) are listed in Tablefh The fixation probability of a single mutant is (l ~ 5 ) / (l ~ ~ 0.5001 

for every vertex. Thus, unlike fixation probabilities, absorption times depend on the initial location of the 
mutant. (Some of the absorption times are similar in this case, but no two are the same.) 


C.2. Frequency-dependent games. 

C.2.1. Symmetric games. Consider the instance of the Snowdrift Game that has for a payoff matrix ([^. For 
this game. Table gives the fixation probabilities and the absorption times (rounded to four digits after the 
decimal point) for the death-birth process on the Frucht graph (Fig. with /3 = 1. 

Similarly, for the same game (and update rule) but on the Tietze graph (Fig. with /3 = 0.1, Table 
and Fig. give the fixation probabilities and absorption times for all possible configurations of a single 
cooperator among defectors. 


C.2.2. Asymmetric games. For the death-birth process on the graph in Fig. [^A) with homogeneous strategy- 
mutation rate e = 0 . 01 , we calculate the complete collection of structure coefficients , j (for r = 1 ) 

as follows: Let be the vector indexed by § with -ipi (s) being the frequency of strategy 1 in state s, and 
let 1 be the vector of ones. McAvoy and Hauert (2015a) show that, for any s, Eq. (13) is equivalent to 

-1^ 


1 

-tr 

n 


^ (s, ipi) 1,9=0 


n -1 


£ (S, 1) 1/3=0 


d/3 


3=0 


L (s, 0 ) > 0 , 


(C.l) 


where L = L (T) = /|s| — T is the (outdegree) Laplacian matrix of the graph defined by T. If fc e {1, 2}, i 
and j are fixed, and we choose the (two-strategy) asymmetric game so that 


t 7 


1 s = 1, t = k, i' = i, j' = j; 
0 otherwise, 


(C.2) 
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initial vertex of mutant 

fixation probability 

absorption time 

1 

0.6505 

116.0959 

2 

0.6471 

115.4026 

3 

0.6469 

115.7302 

4 

0.6448 

115.7348 

5 

0.6463 

116.0100 

6 

0.6562 

117.4671 

7 

0.7299 

129.8609 

8 

0.6512 

116.6906 

9 

0.6545 

118.3795 

10 

0.6551 

117.8995 

11 

0.7344 

131.6681 

12 

0.7326 

131.9634 


Table 2. The fixation probabilities and absorption times of the 12 initial configurations 
of a single cooperator among defectors for the death-birth process on the Frucht graph. 
Payoffs are frequency-dependent and derived from the Snowdrift Game, §. The intensity 
of selection is /3 = 1. 


initial vertex of mutant 

fixation probability 

absorption time 

1 

0.3777 

70.7869 

2 

0.3777 

70.7869 

3 

0.3777 

70.7869 

4 

0.4141 

76.5048 

5 

0.4186 

77.3094 

6 

0.4186 

77.3094 

7 

0.4141 

76.5048 

8 

0.4186 

77.3094 

9 

0.4186 

77.3094 

10 

0.4141 

76.5048 

11 

0.4186 

77.3094 

12 

0.4186 

77.3094 


Table 3. The fixation probabilities and absorption times of the 12 initial configurations 
of a single cooperator among defectors for the death-birth process on the Tietze graph. 
Payoffs are frequency-dependent and derived from the Snowdrift Game, §. The intensity 
of selection is /3 = 0.1. These values are illustrated graphically in Fig. 


then 



^ (Sj V'l) 1/3=0 


-1 


£ (S, 1 ) 1/3=0 



d 


3=0 


£(s,o; 


(G.3) 


Using this method, we obtain the structure coefficients for Fig. [^A) listed in Table For the same process 
on the symmetric graph of Fig. [^B), we find that and are independent of i and j and are both equal 
to 2189/27728. 
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lixation probability 



Figure 8 . Fixation probability (A) and absorption time (B) versus initial vertex of mutant 
(cooperator) for a death-birth process on the Tietze graph. In both figures, the game is a 
Snowdrift Game whose payoffs are described by payoff matrix ([^, and the selection intensity 
is P = 0.1. This example illustrates the single-mutant states that are not evolutionarily 
equivalent in the Tietze graph. Moreover, it happens to be the case that any two of these 
states with the same fixation probability (or absorption time) are evolutionarily equivalent. 


ihj) 

11 

^2 

(1,2) 

707905/9315552 

32989/405024 

(1,4) 

16291/194074 

57057/776296 

(1,6) 

707905/9315552 

32989/405024 

(2,1) 

707905/9315552 

32989/405024 

(2,3) 

16291/194074 

57057/776296 

(2,6) 

707905/9315552 

32989/405024 

(3,2) 

16291/194074 

57057/776296 

(3,4) 

707905/9315552 

32989/405024 

(3,5) 

707905/9315552 

32989/405024 

(4,1) 

16291/194074 

57057/776296 

(4,3) 

707905/9315552 

32989/405024 

(4,5) 

707905/9315552 

32989/405024 

(5,3) 

707905/9315552 

32989/405024 

(5,4) 

707905/9315552 

32989/405024 

(5,6) 

16291/194074 

57057/776296 

(6,1) 

707905/9315552 

32989/405024 

(6,2) 

707905/9315552 

32989/405024 

(6,5) 

16291/194074 

57057/776296 


Table 4. The structure coefficients in Eq. (|l4| for the death-birth process on the vertex- 
transitive (but not symmetric) graph of Fig. iTp.) with homogeneous strategy-mutation rate 
e = 0.01. 
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